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0\ ; Abstract 

^ ' Motivated by its relevance to various types of dynamical behavior of network systems, the max- 

I ■ imum eigenvalue \a of the adjacency matrix A of a network has been considered, and mean-field- 

type approximations to Xa have been developed for different kinds of networks. Here A is defined 
' by Aij = 1 [Aij = 0) if there is (is not) a directed network link to i from j. However, in at 

least two recent problems involving networks with heterogeneous node properties (percolation on 
a directed network and the stability of Boolean models of gene networks), an analogous but differ- 
ent eigenvalue problem arises, namely, that of finding the largest eigenvalue Ag of the matrix Q, 
where Qij = qiAij and the 'bias' qi may be different at each node i. (In the previously mentioned 



^2 ' percolation and gene network contexts, qi is a probability and so lies in the range < gfj < 1.) The 

purposes of this paper are to extend the previous considerations of the maximum eigenvalue Xa of 



' j4 to Aq, to develop suitable analytic approximations to Ag, and to test these approximations with 



numerical experiments. In particular, three issues considered are (i) the effect of the correlation (or 
anticorrelation) between the value of qi and the number of links to and from node i; (ii) the effect 
^ \ of correlation between the properties of two nodes at either end of a network link ('assortativity'); 

and (iii) the effect of community structure allowing for a situation in which different g-values are 
associated with different communities. 
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I. INTRODUCTION 



Topological properties of networks have received much attention. The coarsest topological 
property is the degree distribution, where the in-degree d-" and out-degree c?°"* of a network 
node i are defined as the number of directed network links pointing into and away from node 
i. At each node, the in-degree and out-degree may be correlated; this correlation can be 
characterized by 

r, = (1) 

where (■) denotes the average of the indicated quantity over all network nodes. (Since every 
out-link of a node is an in-link for some other node, (d^^) = (d""*) = (d).) Additionally, 
networks can be assortative or disassortative pLj], i.e., nodes with high degree may prefer 
or avoid connecting to other nodes of high degree. We characterize this by a correlation 
coefficient p between the in-degrees dT and the out-degrees c?""* at either end of a directed 
link from node j to node « [2|, |3|], 

P={dTdf;-%/iv{d)r, (2) 

where (■)£ indicates an average over all network links. If p > 1, the network is assortative, 
if p < 1 it is disassortative, and it is neutral if p is exactly one. Another example of 
topological structure is the existence of communities j^, which are groups of nodes that 
tend to be densely interconnected within the group but sparsely connected between groups. 

In addition to static topological properties of networks, another area of recent interest 
has been dynamical processes taking place on networks. Examples include synchronization 
of coupled identical dynamical systems (which may be chaotic) [5!], the onset of coherence 
in the evolution of heterogeneous network-coupled dynamical systems (both oscillatory 6|, 



ks 



8|, 



as well as chaotic [31), the onset of instability in discrete state models of gene networ 

a pnQ 

percolation on directed networks [9| , and others. In several of these examples [7|, 18|, 19| , an 
important determining quantity was shown to be the maximum eigenvalue of the adjacency 
matrix A, the elements of which are defined to be Aij = 1 if there is a directed link to node 
i from node j and zero otherwise for all i, j = 1, 2, A^, where A^ is the number of network 
nodes; An = by definition. 

Motivated by the importance of Xa to these dynamical problems, Ref. ^ developed 
theory for obtaining large A^ approximations to from knowledge of statistical character- 
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izations of the network. For example, it was shown [2^ that random networks constrained 
only by specification of the joint degree distribution P((i*", d""*) have 

\a ~ (rt°"*)/(c/) =v{d), (3) 

where P{d^^, d°^^) is the probability that a randomly chosen node has in-degree d*" and 
out-degree d""* . From ([3]) it is seen that nodal correlation or anticorrelation between ci*"' 
and increases or decreases A^. If an additional assortativity constraint is imposed, then 
Ref. 1^ obtains 

XA^PVid), (4) 

to lowest order in {p — 1). Thus assortativity (p > 1) tends to increases Xa, and disassorta- 
tivity (p < 1) tends to decrease A^. 

However, we note that in two of the cited applications (namely, gene network stability 
and site percolation on large directed networks 91] ) , the formulations resulted in a somewhat 
more general eigenvalue problem. Specifically, this problem was that of determining the 
largest eigenvalue Aq of a generalized adjacency matrix Q whose elements are given by 

Qij — Qi-^iji (5) 

where qi is the 'bias' characterizing node i which may be different for each node. In the 
special case of uniform = q for all i, the problem for Xq reduces to that for A^, i.e., 
Xq = qXA, and the previous results such as Eqs. ([3]) and (j4]) can be employed. However, it 
is also of interest to consider the more general problem of determining Xq for nonuniform 
biases, and it is that problem to which this paper is devoted. We note that in the site 
percolation context [9], qi = (1 — Pi), where pi is the probability that node i is removed, 
while in the gene network context [8], qi is the probability that the output of gene (node) 
i is switched to another state if one or more of its randomly chosen inputs is switched. In 
either case, qi is in the range < < 1, and we accordingly restrict ourselves to > 0. 
Since Qij > 0, the Frobenius-Perron theorem implies that Aq is real and positive. 

Our analysis will consider 'Markovian' random networks (see Sec. HI])- This type of 
consideration was used in the analysis of A^ in Ref. pj], as well as in a variet y o f other 
interesting studies of different network related problems (e.g., Refs. [lO, H, 12, 13] which 



consider epidemic spreading and percolation). Basically, a Markovian network is one for 
which the only nontrivial spatial correlations are between nodes that are directly connected 



by a single link. Within this framework, we formulate a theory for determining the Xq of 
large networks, and we utilize our theory to examine several significant situations of interest. 
Examples of our results are a generalization of Eq. ([3D (see Eq. fll7l) ) showing that correlation 
between q and increases Xq, a generalization of Eq. (jl]) (see Eq. (1251) ) showing that 

correlation between q^qj and d^^^dj^ on edges from j ^ i increases Xq, and an analysis of 
the effect on Xq of network communities tending to have different, community-dependent q 
values (see Eq. [Ml) . 

For later reference we note the following relationships involving the adjacency matrix, 

N N 



df 



i=l 



E-4 

i=i 



(6) 
(7) 
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II. MARKOVIAN NETWORKS 

We characterize each node i by four attributes: its in-degree d*" , its out-degree d""* , its 
'bias' qi, and its group (or community), labeled (jj. We call the triplet = (rf*", g^) the 
'generalized degree' of node i. The number of groups is denoted s, so that a = 1,2, s. If no 
two nodes have the same attributes {z, a), then there is a one-to-one correspondence between 
i and {z,a) E {{z^,o-k)\k = 1,2, ...A^}. We consider A^-node random networks specified by 
the following quantities: (i) the number of nodes in each group No- (X]ct=i = N); (ii) 
the degree distribution Pa{z) for group a (a = l,2,...,s) giving the probability that a 
node randomly chosen from group a has generalized degree z ; and (iii) the probability 
Il{z,a\z',a') that, if a randomly chosen link originates from a node in group a' that has 
degree z^, then that link points to a node in group a with degree z . Note that, since every 
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out-link for a node is an in-link for some other node, the degree distributions Pcr{z) are 
constrained to satisfy the relation, 

J2 N,P,{z)d''^' = N^PAz)d'^, (10) 

which we denote N{d). Furthermore, we have that Il{z,a\z^,a') satisfies the probability 
normalization condition, 

$^nU,a|/,(T') = l. (11) 

By use of this model, we essentially assume that the only non-trivial correlation between 
the attributes of two different nodes occurs when they are directly connected by a single 
link. For example, if we choose a random outward path of length two from a node in 
group (Ja of degree , then the probability that the first leg of the path goes to a node 
having (^^, at) , and the second leg of the path goes to a node having {z^, cTc) is given by 
n(Zc, o-ckfe, crb)n(26, ab\z^, aa). 

In order to find the maximum eigenvalue of Q, we consider the iteration = Qu^"^^ 

which, for a typical initial choice of u^'^^ converges on the eigenvector u corresponding to 
the largest eigenvalue Xq. Relabeling the nodes by their attributes {z, a) , we write the 
components of the vector m = M2, Mat] as = cTj). The ensemble average of the 
iterated vector thus evolves according to 

v^''\z,a) = g$^$^n(z,aU',a')(rf°"*)'t;(")(^',a'), (12) 

a' z' 

and we denote the eigenvalue of this evolution by Xq, 

AQt;(^,cr) = g5^5^n(^,aU',a')(0'^(^',^')- (13) 

a' z' 

For large N, and a random draw from our Markov ensemble of networks, we suppose that 
Xq from ( |T3i) will typically provide a good approximation to Xq for the chosen network, and 
we will test this supposition using numerical experiments. In the next section, we apply Eq. 
( |T3i) to obtain analytical approximations to Xq for several situations of interest. 
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III. EVALUATION OF Aq 



A. The Effect of Nodal Correlations 

We first consider the case s = 1, corresponding to the absence of group structure. Thus 
the variable a may be omitted from Eq. f|T3|) . We furthermore assume that and Zj on the 
two ends of a hnk from j to i are uncorrelated. Thus there is no assortativity, and n(^|z') 
does not depend on z_'. Under this assumption, n(z|^') is simply the probability that a 
randomly chosen link points toward a node with degree z . This probability is proportional 
to the number of nodes with degree z , and to the number of in-links to such a node, 

nu|/) = (14) 

where the factor (d)^^ provides the necessary normalization from Eq. ( ITTi) . Inserting (HM 
into ffT3l) we have that 



Xqv{z) = qd'-P{z){dr' 5^(ci-*)'t;U0. (15) 

Thus we see that the eigenvector v{z) is 

v{z) = qd'^'Piz), (16) 

which when inserted into (fTSll yields 

Aq = {qd'^d°-')/{d), (17) 

where 

{qd'^'d"^') = J2ld'''d"^'PU). (18) 

z 

Equation (fT7|) is the appropriate generalization of Eq. ([3]) to take into account the node- 
dependent biases qi that appear in the definition, Eq. ([5]), of the matrix Q. 

If q and are uncorrelated, Aq = {q)\A where \a is given by ([3]). On the other 

hand, we see that if q and (i*"c?°"* are correlated (anticorrelated), then Aq is larger (smaller) 
than (g)Ayi- 
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B. Assortativity 



Next we wish to consider how the result in Eq. (fT7|) is modified if we allow correlation 
between z_ and We address this problem perturbatively, and we write n(^|^') as 

nul^O ~ n(°)(z|^') + en(i)u|z'), (i9) 

where e is a small expansion parameter, and n*^°)(^|2') is given by the uncorrelated result, 
Eq. f|T^ . Similarly expanding the eigenvalue Aq and the eigenvector we have 

Aq ^ Ag)+eA«, (20) 
v[z) ^ v^''\z)^e4'-\z), (21) 

where Ag^ is given by f|T7|l and f^°^(z) is given by f|T6|) . Inserting f|T9|) -fl2Tl). f|T^ . f|T6|) . and 
(frfl) into (fT3l) . multiplying the resulting equation by , and summing over all z_ , the 
terms involving v^^^{z) cancel. Thus we obtain 

eAg^Ag) = e J]grf°"*(rf^")'g'n(^)(^|.')P(^), (22) 

where 

P{z) = (r'''P{z)l{d). (23) 

is the probability that a randomly chosen link originates from a node of generalized degree 
z_ . With this interpretation of ( !23l) . we see that ( !22l) can be re-expressed in terms of the 
link average (■)£, 

eAgU^j") = e{qdT'dfq,)e - {q.dr')e{q,df),, (24) 

where we use the convention that j {i) labels the node that the link comes from (points to). 
Proceeding as in Eq. we obtain 

(g.C)e = {qjd^)e = = Ag\ (25) 

which when inserted in fl2^ yields 

Aq ^ Ag) + 6A« = (g.rfrrfr^.)^/AQ • (26) 

Now defining a new assortativity coefficient appropriate to networks with heterogeneous 
biases Qi, we write 

^ {qdr'dfqj)e ^ {qjdr'dfqj), 

{q^dr')e{q,df), (AW)2 ' ^ ^ 
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in terms of which Eq. (126|) takes the suggestive form, 

Aq ^ A^Vq- (28) 

Thus bias assortativity (disassortativity), corresponding to pq > 1 (pg < 1) yields Xq > Xq^ 
(Aq < Aq'*). Equations 1^7^) and (1251) generalize Eqs. ([2]) and (jl]) for to results for Xq. 



C. Community and Bipartite Structure 

We now consider how the presence of several network groups (s > 1) influence Aq. As 
in Sec. IIII A\ we assume that is uncorrelated with Zj , where and Zj are at either 
end of a link from i to j. However, we do include correlations between cxj and aj along this 
link, and we characterize this correlation by the s x s matrix of transition probabilities Paa' 
, giving the probability that a randomly chosen out-link from a node in group cr' connects 
to a node in group a. With these assumptions, we have the following result for Il{z_, a\z', a') 
(analogous to (fT4|) ). 

nU, a\z!, a') = D-\a')p^,,d'''P^{z), (29) 
where D{a') = J2z a -Po-(^)'^*"Po-o-' is a normalizing factor (see Eq. (ITT]) ). Inserting (12^ into 

^^Qv{z,a) = qY,D-\(j')d'y.^,P,{z){d"^')'v{z:,a'). (30) 

Equation (!30|) immediately determines the z dependence of v{z,a). Thus we can write 

v{z,a) = qd'''P„{z)w{a), (31) 

where the a dependent quantity w{a) is, as yet, undetermined. Substituting ( l3T|) into ( !30|) 
we obtain the following eigenvalue equation for w((t) and Aq, 

'w{a'), (32) 

cr 

where M is the 5x5 matrix, 

M^^, = D-\a'){qd'"d''^'),,p,,,, (33) 

where (■)o- = X]z(')-Po-(^)- Thus the N x N eigenvalue problem for Aq is now approximated 
by the much smaller s x s eigenvalue problem (l32l) . 

Aq = max. eigenvalue [M]. (34) 
8 



We have also expanded the group eigenvalue problem to obtain the correction to that 
is introduced by including correlations between and z_j along links from j to i. This 
analysis proceeds in a manner similar to that in Sec. IIII Bl and is omitted. 

Note that in the case where the off-diagonal transition probabilities are zero, Pa^' = 
for a 7^ a', we have s completely disconnected groups, and that, for p^„//N„ independent 
of a and a', the group-dependence on the connectivity is absent. If the diagonal terms of 
the matrix p^^i/N„ are larger than the off-diagonal terms, then we say there is 'community 
structure' (i.e., the density of intragroup connections is larger than the density of intergroup 
connections). 

At the opposite extreme, for the case of two groups (s = 2), if the diagonal components 
of the transition probability matrix are zero {p^a = for a = 1,2), then connections exist 
only between, and not within, the two groups, i.e., the network is 'bipartite.' Thus, if the 
diagonal terms of the matrix Patji /N„ are smaller than the off-diagonal terms, then we say 
the network has 'bipartite structure.' 

In our numerical tests of Eq. (1341) in Sec. (IIV CI) , we will consider two groups (s = 
2; cr = 1,2) with equal sizes {Ni = N2 = N/2) and with symmetric transition properties 
{pii = P22 = Po, P12 = P21 = Px)- We will, in addition, restrict our consideration to the case 
where the in-degree/out-degree distributions are the same for the two groups, but we will 
allow the biases q for the two groups to be unequal, with the g's not correlated with rf*" and 



I.e., 



p.(^) = p'^(d*",0^.'(?)- 



(35) 



With these conditions Eq. reduces to 



{q)a'^Paa', 



(36) 



where 



i = D-^(l)(«°"*)i = D-i(2)(«°"*) 



(37) 



or 



Po{q)i Px{q)i 

Px{q)2 Po{q)2 



(38) 



From Eqs. (IM]) and (l38l). 



Aq = e {po((g)i + (g)2) + [po{{q)i - {q)2f + 4p.(g)i(g)2)] /2 



(39) 
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Equation (139|) can be put in a somewhat more reveahng form by introducing q± = ± 
(g)2)/2, in terms of which (l39l) becomes 

Aq = e {pog+ + [(Po - pDq- + '^'} • (40) 

From fHOj) we see that, if we keep g+ (the average q value for the whole network) fixed, but 
allow the difference between the average g's in the two groups to increase (i.e., we increase 
|g_|), then Aq increases if the network has community structure (po > Px), but it decreases 
if the network has bipartite structure {px > Po)- 

IV. NUMERICAL TESTS 

A. First-order Approximation 

We test the predictions of Eq. f|T71) on networks with equal power-law in-degree and 
out-degree distributions. To construct the networks used to test this hypothesis, we follow 
the method used in In particular, we first randomly construct a list of degree values 
by choosing random numbers drawn from a given distribution, in this case, 

{d-^, d'^'" <d< rf™'^^, 
(41) 
0, otherwise. 

We use 7 = 2.5 and adjust d™" and d"^"-^ to tune (d) . We then assign each number on this 
list to each node i and we call this assignment the 'target' in-degree df^ . Next we use this 
same list to assign to each node i a target out-degree , and perform this assignment 
in one of three ways: (i) = d*", yielding maximal {d''^d°^^) and r/; (ii) d°^^ randomly 
drawn from the list, yielding ^ (d)"^ and 77 1; or (iii) the node with the largest 

d*" is assigned equal to the smallest value on the list, the node with the second largest 
(i*" is assigned d°^^ equal to the second smallest value on the list, etc., yielding minimal 
and rj. Once the d*" and are assigned, we construct the network by setting the 
elements of the adjacency matrix Aij = 1 with probability d''l^d°^^ /N{d) (where {d) = {d) is 
the average of the list values) and otherwise. 

After the network is constructed, we assign the biases qi drawn from a uniform distribution 
on the interval [0, 1]. For each of the three values of (rf^c?""*), we tune (grf^c?""*) by swapping 
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• Minimal \\ 

A n= 1 

■ Maximal r] 
Open: <d> = 10 
Filled: <d> = 100 



0.4 0.6 0.8 1.0 1.2 1.4 

in out , , 2 

<qd d >/<d> 

FIG. 1: Xq/id) vs. {qcT^d"^^) / (d)'^ for networks of size N = 10^ with no assortativity and 
{d) = 100 (filled markers) and (d) = 10 (open markers). For both values of {d), three values of 
rj are considered: maximal (circle), neutral (triangle) and minimal (squares). Each marker is the 
average of 10 networks, and the solid line is the theoretical prediction, \Q/{d) = 

the biases of random pairs of nodes to increase or decrease (grf^d""*). For example, if we wish 
to obtain increased , we only keep those swaps that increase {qd^^d"^^). In Fig. [H 

we plot the measured normalized eigenvalue \Q/{d) vs. {qd^'^d"^'^) / (d)"^ for (d) ^ 10 (open 
markers) and (d) ^ 100 (filled markers) for maximal (circles), minimal (squares), 

and neutral (triangles) averaged over 10 networks. As can be seen, the markers all fall on 
the solid line, \Q/{d) = 

B. Assortativity 

In Fig. [2] we test the predictions of Eq. fl25]) . Baseline networks of size = 10^ with 
?7 ^ 1 and p ^ 1 are constructed as described above, with the biases qt drawn from a uniform 
distribution on the interval [0, 1]. We then consider two methods of tuning pg, method (a), 
which yields networks with pg ^ 1 but no correlation between the degrees and the bias at 
a given node, and method (b), which introduces nodal degree-bias correlations. 

Method (a). This method is a modified version of the algorithm in j^: (i) Randomly 
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choose two links going from ji — * ii and j2 ii- (ii) Calculate dC'-[d°^^ qj^qi^ + d^j^d"^^ qj^qi^ 
and d^^d°^^ qj^qi^ + d^J^d^^^qj^qi-^. (iii) If the latter value is larger or smaller (depending on 
whether the target pg is greater or less than one), delete the original links and place new 
links from ji 12 and j2 — > otherwise keep the original links, (iv) Repeat this process 
until the target pq is achieved. 

Method (h). This method is a two-step process. First, we tune p by swapping inputs 
of random link pairs, and we do this without regard to the node biases, as in ^, yielding 
a network with pq p. Once p is tuned, we futher tune the bias assortativity pq by the 
following: (i) Randomly choose two nodes, i and j. (ii) Calculate the change in pq that 
would result if the g's at these two randomly chosen nodes were interchanged, (iii) If it is 
desired to increase (decrease) pq and the change in pq is positive (negative), then swap the 
q values; otherwise do not make the swap, (iv) Repeat the above process until the target 
Pq is achieved. 

The results of these two methods are in Fig. O Each marker in the figure is the average 
of 10 networks of size N = 10^, and we consider networks with (d) = 10 (open markers) and 
(d) = 100 (filled markers) tuned with both methods. In Fig. EJ^a), we plot the normalized 
eigenvalue Xq/{d) vs. pq for networks tuned with method (a). Since rj is approximately 
unity and the are assigned independently of the node degrees, Xq^ ~ {d){q)', the theoretical 
prediction (solid curve) is therefore Xq/ {d) = pq{q). The results of method (b) are shown in 
Fig. [2](b). We consider networks tuned to p ~ 0.8 (circles), 1.0 (triangles), and 1.2 (squares). 
Note that swapping the q values in method (b) changes Xq^ as well as pq, and thus Xq^ 
must be calculated for every marker. We therefore plot Xq/ (d) vs. X^q Pq/ (d), and we see 
that all the points fall on the theoretical prediction, Xq/ {d) = x!q Pq/ {d) . 



C. Community Structure 

In Fig. [3] we test the predictions of the community structure theory for a network of size 
= 10"^ with two equally sized groups. Networks are constructed as described Sec. IIII C[ 
Aij = 1 with probability Pq if j and i are in the same group or probability if i and j 
are in different groups. We then consider four cases: two completely separated components 
(yPx = 0, circles), strong community structure {px = Po/2, squares), no group structure 
{Px = P01 upward pointing triangles), and strong bipartite structure {px = 2po, downward 
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FIG. 2: (a) \Q/{d) vs. pq for a network of size = 10000 and average connectivity {d) = 
10 (circles) and {d) = 100 (squares). Each marker is the average of 10 networks. (h)\Q/{d) 
vs. ^Q^PQ/{d) for networks with structural assortativity of 0.8 (circles), 1.0 (triangles), and 1.2 
(squares) of size N = 10000 and average connectivity {d) = 10 (open markers) and (d) = 100 (filled 
markers) . 

pointing triangles). The groups have uniform biases, qi = q+ + Q- and q2 = q+ — q~, with 
g+ = 0.5 and g_ varying from to 0.5. We plot the measured Xq vs. the difference in group 
biases, g_, averaged over 10 networks. The solid curves are the theoretical predictions of 
Eq. (1401) . and markers are the average of 10 networks. 

Again we obtain excellent agreement between the theory and the numerical tests. Note 
that, as mentioned in Sec. IIII CI the effect of increasing q_ is to increase Xq in the case with 
community structure and to decrease Xq in the case with bipartite structure. 



V. CONCLUSION 

Motivated by recent work on the stability of gene network models 8| and on percolation 
on directed networks j^, we have developed and numerically tested theoretical predictions 
for the maximum eigenvalues Xq of the modified adjacency matrix Q defined by Eq. ((51). 
Using a Markov network model (Sec. [Tll), we calculate approximations to Xq for various 
situations (Sec. IIIip . In particular, we considered: (i) the effect of correlation between the 
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q. 

FIG. 3: Xq vs. q- for networks of size N = 10^ with two equal groups of varying type: two com- 
pletely separated components {px = 0, circles), strong community structure {px = squares), 
no group structure {px = Po, upward pointing triangle), and strong bipartite structure {px = 2po, 
downward pointing triangle). Each marker is the average of 10 networks, and the solid curves are 
the theoretical predictions of Eq. (00]). 

bias g at a node with the product d^^d°^^ at that node; (ii) the effect of correlations between 
the degrees and biases for nodes at the two ends of a network link; and (iii) the effect of 
the existance of groups of nodes with community or bipartite structure in which different 
node bias distributions apply to different groups. We find that the effects discussed strongly 
influence the value of Ag, and in all cases our numerical tests (Sec. HVT) resulted in excellent 
agreement with our theoretical results. 
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